Inference is Everything: Recasting Semantic Resources into a Unified Evaluation Framework
نویسندگان
چکیده
We propose to unify a variety of existing semantic classification tasks, such as semantic role labeling, anaphora resolution, and paraphrase detection, under the heading of Recognizing Textual Entailment (RTE). We present a general strategy to automatically generate one or more sentential hypotheses based on an input sentence and pre-existing manual semantic annotations. The resulting suite of datasets enables us to probe a statistical RTE model’s performance on different aspects of semantics. We demonstrate the value of this approach by investigating the behavior of a popular neural network RTE model.
منابع مشابه
Semantic Inference at the Lexical-Syntactic Level
Semantic inference is an important component in many natural language understanding applications. Classical approaches to semantic inference rely on complex logical representations. However, practical applications usually adopt shallower lexical or lexical-syntactic representations, but lack a principled inference framework. We propose a generic semantic inference framework that operates direct...
متن کاملCrowdsourcing Inference-Rule Evaluation
The importance of inference rules to semantic applications has long been recognized and extensive work has been carried out to automatically acquire inference-rule resources. However, evaluating such resources has turned out to be a non-trivial task, slowing progress in the field. In this paper, we suggest a framework for evaluating inference-rule resources. Our framework simplifies a previousl...
متن کاملSemantic Web Standards
Semantic Web is set to become the future because it makes the understanding between humans and machines easy. In this paperSemantic Web Standards, such as RDF and OWL, the current semantic developing languages, are going to be examined. Before talking about those two languages, Semantic Web will be introduced, along with its related vocabularies, which enable the construction of the Semantic We...
متن کاملKnowledge Representation for Syntactic/Semantic Processing
1. Introduction This paper discusses some theoretical implications of recasting parsing and semantic interpretation as a type of inference process which we call incrementalhescription refinement.* It draws upon our recent experience with RUS. a framework for natural language processing developed at BBN and in use in several different natural language systems across the country (for details see ...
متن کاملNference - R Ules via C Rowdsourcing
The importance of inference rules to semantic applications has long been recognized, and extensive work has been carried out to automatically acquire inference-rule resources. However, despite their potential, the utilization of inference rule resources is currently somewhat limited, in part due to the considerable number of rules which are in fact invalid. A possible solution to this problem i...
متن کامل